SPECIFICATION 

TITLE OF THE INVENTION 

METHOD AND APPARATUS FOR DYNAMIC LOOP AND POST 
FILTERING 

BACKGROUND OF THE INVENTION 

The present invention relates to a method and an 
apparatus for a dynamic loop and post filtering. The method 
or apparatus for the dynamic loop and post filtering of 
decoded video is applicable to multimedia and video 
applications. In particular it is useful for the delivery 
of video over low bandwidth networks such as Internet where 
the picture quality is badly affected by a coding artefact 
such as blocky noise. 

Filtering is a very common signal processing technique 
that is used to process a picture to enhance or change its 
appearance. Forms of the filtering can be broadly 

classified into two categories. They are picture 

enhancement and picture restoration. This disclosure 

mainly deals with the latter case of picture restoration. 
Degradation to the picture is introduced by the compression 
technique. In particular, the most common type of the 
degradation is a blocky artefact that results from high 
compression in a block-based transform-coding technique. 

Fig. 1 shows a typical block-based transform codec 



(coder-decoder) . As shown in Fig. 1, an encoder and a 
decoder form a synchronized pair. The encoder emulates 
decoding operations in a local decoder. The typical 
encoder comprises a block discrete cosine transform (DCT) 
module 11, a quantization (Q) module 12, a variable length 
coding (VLC) module 13, an inverse quantization (IQ) module 
14, an inverse DCT (IDCT) module 15, a frame store module 
16 and a motion compensation module 17. A picture is 
passed into the encoder where it is partitioned into blocks. 
Apart from the non-predicted picture (normally referred to 
as I-Pictures or Intra picture), the blocks undergo motion 
compensation where the previous decoded picture is 
subtracted from the current block. These blocks are then 
passed to the DCT module 11 where they are transformed into 
the DCT domain. The transform coefficients are then 
•quantized by the Quantization module 12 and entropy-coded 
in the VLC module 13 before being sent to the decoder. The 
encoder also emulates the operations of the decoder by 
performing an inverse quantization step on the quantized 
coefficients and then transforming the coefficients back 
into the spatial domain. At this point, the motion 
compensated prediction, if it was used earlier, is added to 
the block to form the reconstructed picture. The 
reconstructed picture is stored in the frame store 16 where 
it is used by the motion compensation module 17 for the 



prediction of the next picture. 

The typical corresponding decoder coinprises of a 
variable length decoding (VLD) module .18, an inverse 
quantization (IQ) module 19, an inverse DCT (IDCT) module 
20, a frame store module 21 and a motion compensation 
module 22. Noticed that apart from the VLD module 18 that 
performs the entropy decoding, the remaining modules 19 to 
22 are identical to the modules 14 to 17 of the local 
decoder in the encoder. These modules perform the same 
function as described above. 

The blocky artefact mentioned above is caused by the 
quantization step where noise is added to' crucial low and 
high frequency components. This results in discontinuities 
at the block boundary of the picture, which shows up as 
blocky noise. 

There are several forms of blocky noise removal 
filters. The first 'is a simple form of post filter 210, as 
shown in Fig. 2. This form of filter is placed at the 
output of the video decoder and only affects the picture 
being displayed. The second form of filter is a loop 
filter. This is placed in the motion compensation loop of 
the encoder and decoder. There are two places where the 
filter may be placed in the loop. The first is after the 
motion compensation block 310, as shown in Fig. 3. The 
second is before the frame store 410, as shown in Fig. 4. 



4 



The first case is used in codecs such as the ITU-TH 261 
standard. In this disclosure, the term of loop filter will 
refer to the second case where the. filter is placed before 
the frame store 410. 
5 In the case of the post filter, the filter affects 

only the output display picture. There is no propagation 
effect because the filtering effect is not stored in the 
frame memory. In the loop filter, there is a propagation 
effect of the filter because the filtered picture is stored 

1;^ into the frame memory and is used for the motion 

i=S compensation of the subsequent picture, 

fj Currently, the most effective filters used for 

□ filtering blocky noise uses knowledge that the 

m discontinuities appear only at specific locations of the 

p 15 picture, namely at the block boundary. This allows the 
filter to remove the blocky noise without introducing 
excessive smoothing 'to the detail of the picture. 

At high bit rates, where the motion compensation 
residual is coded by the transform coefficients, the post 
20 filtering technique is effective. The blocky noise present 
in the frame store is repaired by the transform 
coefficients being sent at subsequent pictures. So only 
the output picture need to be filtered. Putting the filter 
into the loop would actually cause propagation effect and 
25 reduce the overall picture quality. 



At low bit rates, where the motion compensation 
residual is not completely coded, the loop filtering 
technique is. more effective. This is because the blocky ' 
noise present in the frame store is not repaired by the 
transform coefficients being sent in subsequent pictures. 
Therefore, in the post filter case, the propagated blocky 
noise is not removed especially in the case where motion 
compensation has shifted the discontinuities to positions 
other than the block boundary. 

Therefore, the first problem to be solved is how to 
integrate two types of filters since each of the filters is 
only effective at different . ends to the bit rate 
distribution . 

The second problem is how to keep the bit rate down in 
the low bit rate case when the loop filter is removing 
picture detail from the frame store, 

SUMMARY OF THE INVENTION 

The first problem is solved by dynamically switching 
between the post filter and the loop filter based on some 
criteria derived from the bit stream or picture content. 
The inventive step lies in the way the loop filter and the 
post filter are combined and switched on a picture by 
picture basis depending on the information extracted from 
the bit stream and/or the decoded picture. It is also 
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possible for the encoder to signal the switching explicitly 
to the decoder by using a flag in the bit stream. 

Implementing a mismatch between the local decoder in 
the encoder and the decoder solves the second problem. 
This allows for the same encoder to be used for both the 
post filter and loop filter cases. This is not entirely 
obvious and may even be theoretically incorrect since the 
main purpose of the local decoder in the encoder is to 
ensure that the reference frame of the encoder and decoder 
are always in synchronization. By deliberately introducing 
the loop filter in the decoder motion compensation loop 
only . and not doing the same in the local decoder of the 
encoder, noise will accumulate and the two reference frames 
would go out of synchronization. This is commonly referred 
to as drift. However, at very low bit rates, the effect of 
the drift is smaller than the potential improvement in the 
potential quality of' the decoded picture. Furthermore, the 
loop filter introduced also has some drift minimizing 
properties . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Various characteristics and advantages of the present 
invention will be further described in details by the 
following preferred embodiments. 

Fig. 1 is a block diagram showing a typical pair of 



encoder and decoder used for compression and decompression 
of moving pictures. 

Fig. 2 is a block diagram ' showing the location of the 
filter as a post filter for the pair of encoder and decoder. 
Noticed that the post filter is placed at the output stage 
of the decoder and has neither influence nor impact on the 
encoding and decoding loops. 

Fig. 3 is a block diagram showing the location of the 
filter as a loop filter for moving pictures (Case 1). The 
filter is placed in the motion compensation loop after the 
motion compensation module. 

Fig. 4 is a block diagram showing the location of the 
filter as a loop filter for moving pictures (Case 2). The 
filter is placed in the motion compensation loop before the 
frame store module. 

Fig. 5 is a block diagram showing the current 
invention with dynamic switching of the loop filter. A 
coding parameter extraction module is used to gather 
information about the picture in order to decide on the 
switch position to use for each picture. 

Fig. 6 is a flowchart for 2-state dynamic switching 
decision . 

Fig. 7 is a block diagram showing the current 
invention with dynamic switching of the loop and post 
filter. A coding parameter extraction module is used to 
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gather information about the picture in order to decide on 
the switch position to use for each picture. 

Fig. 8 is a block diagram showing the current 
invention with dynamic switching of the loop and post 
filter. The loop filter is independent of the post filter. 
A coding parameter extraction module is used to gather 
information about the picture in order to decide on the 
switch position to use for each picture. 

Fig. 9 is a flowchart for 3-state dynamic switching 
decision . 

Fig. 10 is a view of the motion prediction direction 
of P- and B-pictures. This figure , shows the direction- 

of the motion compensation. Only and P- pictures are 

stored in the frame store since they are used for the 
prediction of the future pictures. B-Pictures are not used 
for prediction and therefore need not be stored in the 
frame store. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

This application is based on an application No. 2000- 
084396 filed in Japan, the content of which is herein 
expressly incorporated by reference in its entirety. 

Hereinafter, preferred embodiments of the present 
invention will be specifically described. An embodiment of 
the present invention is shown in Figs. 5 and 7. This 
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embodiment shows a case of the present invention where the 
encoder is not modified. At the decoder, a filter 510 is 
placed at the output of the , video decoder. A new 
functional module referred to as a coding parameter 
5 extraction 520 is added. The purpose of this module is to 
extract the coding parameters of the current macroblock or 
picture. By extracting the information, the decoder can 
make a decision on whether to switch in the filter or not. 
This is done through the control line 530 and the switch 

i-s a 

In the present embodiment, the coding parameter 
"Ti extraction 520 calculates the mean value of . the 

;3 quantization parameter for the whole picture. The mean 

^ij value is then used to decide if the current picture, which 

□ 15 is stored in the frame store 550, should be from the 
unfiltered reconstructed picture or the filtered 
reconstructed picture. This is done via the switch 540. 
When the quantization parameter is small, this means the 
quality of the picture is good. In this case the output 
20 picture is filtered but the picture, which is placed in the 
frame store, is not filtered. This means that the switch 
should be at position A. When the quantization parameter 
is big, this means that the quality of the picture is bad 
and there is likely to be very blocky noise. In this case 
25 the output picture is filtered and the picture to be placed 
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in the frame store is also filtered. This means that the 
switch should be at position B. 

Fig. 6 shows the flowchart for this decision. The 
decision starts by calculating the mean value of the 
quanization parameters for the frame by summing all of the 
quantization parameters and dividing by the number of macro 
blocks in the picture . Once this value is obtained, it is 
compared to a predefined threshold. If the value is not 
greater than the threshold, then the switch is set to the 
position A. The unfiltered reconstructed picture is copied 
to the frame store. If the value is greater than the 
threshold,, then the . switch is set to the position B. The 
filtered reconstructed picture is copied to the frame store 
The process then checks if there are more pictures to 
process. If there is, then the process repeats again with 
the next picture as the input . 

Note that regardless of the location of the switch, 
the output picture sent to the display is always from the 
filtered reconstructed picture. 

Fig. 7 shows a variant of the invention depicted in 
Fig. 5. Most of the components are the same as that 
discussed previous except that an additional option that 
further improves the output image. An additional switch 
provides options C and D. At position D, the filter works 
as discussed previously. At position C, the output is not 



filtered at both the display and the frame store. This 
option is provided for the case where the quantization 
parameter is neither too big to perform a loop filtering 
(filtering both the frame display and frame, store image) 
nor too small to perform a post filtering (only display 
image is filtered) . In this case, we now have two 
threshold values; an upper threshold value and a lower 
threshold value. If the average quantization parameter 
value exceeds the upper threshold value, loop filtering is 
performed. If the average quantization parameter value is 
below the lower threshold value, post filtering is 
performed. Otherwise, no filtering is performed at all. 

In another embodiment of the present invention shown 
in Fig. 8, the loop filter is now independent of the post 
filter. In Fig. 7, when the switch for the loop filter is 
in position B, the selected picture depends on the 
selection of switch' C and D. In Fig. 8, when the switch 
for the loop filter is in position B, the selected picture 
does not depend on the selection of switch C and D. 

Fig. 9 shows the flowchart of the switching algorithm 
with the new option included. The only difference occurs 
when the threshold is lower. A new decision has to be made 
to determine if the quantization parameter is lower than a 
specified lower threshold. If it is lower, it will operate 
as before, that is, filtering output frame but stores the 



unfiltered frame in the frame store. Otherwise, unfiltered 
frame is output to the display and kept in the frame store. 

The coding parameter extraction can also take several 
other forms. In the above embodiment, it is assumed that 
the coding parameters are extracted or deduced from 
information that are available in the bit stream as part of 
the decoding process. Quantization step-size is one of 
such parameters. However, it is also possible that the 
information for making decision on the switching be 
obtained either implicitly or explicitly. In the implicit 
case, the reconstructed picture is analyzed and the 
appropriate decision is derived. In the explicitly case, 
the encoder makes the decision and explicitly signals it to 
the decoder by sending a flag or parameter in the bit 
stream or by other forms of coimnunication protocol. 

In the case where the encoded sequence contains I-, P- 
and B-pictures, only the I- and P-pictures need to be 
stored into the frame store. This is because a B-picture 
is bi-directionally predicted from its neighboring I- or P- 
pictures and is not used for the prediction of any other 
pictures. Fig. 10 shows the prediction method used. The 
arrows point from the picture used for prediction to the 
predicted picture. 

This invention can operate on a macro block basis. 
Instead of making a decision to filter or not filter the 



entire picture based on the average quantization parameter 
value, we can choose to filter a macro block based on the 
corresponding quantization parameter value. In other words, 
every macro block is filtered or not filtered independent 
of each other, it is only based on its quantization 
parameter value. 

The effects of the present invention are that a new 
dynamic switching loop and post filter technique is derived. 
This filtering technique is effective in reducing the noise 
in low quality heavily compressed video and at the same 
time does not reduce the sharpness of high quality lightly 
compressed video. 

Although the present invention has been fully described 
in connection with the preferred embodiments thereof with 
reference to the accompanying drawings, it is to be noted 
that various changes and modifications are apparent to those 
skilled in the art.' Such changes and modifications are to 
be understood as included within the scope of the present 
invention as defined by the appended ^ claims unless they 
depart therefrom. 



